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REMOTE INTERPRETATION OF MEDICAL IMAGES 

CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] This application is a continuation-in-part of and 
claims priority to U.S. Application Serial No. 09/542,091, 
filed on April 3, 2000, which is incorporated herein in its 
entirety. 

BACKGROUND 

[0002] Pathologists typically use microscopes when 
diagnosing physiological conditions such as cancer, 
infectious disease and prenatal disorders. Typically, 
tissue samples on a slide are loaded onto the microscope, 
the microscope objective or lens focuses on an area of the 
sample, and the sample is scanned for particular features 
or objects of interest. In this manner, the microscope 
helps the pathologist to visually determine the presence of 
abnormal numbers or types of cells, organelles, organisms 
or biological markers. 

[0003] Recently, automated microscopes have been 

integrated into medical imaging systems that include a 
variety of networked components. The medical imaging 
system provides an environment for storing and retrieving 
the medical images produced by the microscopes. The 
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components of the medical imaging system are spread 
throughout the department or hospital, or even located 
remotely, and connected by a communication network. 

[0004] An image acquisition device is coupled to the 
microscope and captures images produced by the microscope. 
The image acquisition device can include a variety of 
components. For example, the image acquisition device can 
include a video camera coupled to a high-speed frame 
grabber for capturing the stream of video produced by the 
video camera and generating a series of digital images. 
Alternatively, the electronic camera can be a megapixel 
digital camera. The microscope and the image acquisition 
device can acquire images for a number of different color 
planes and at several different focal planes. These images 
can be stitched together to form a two-dimensional or 
three-dimensional composite image. As a result of the 
combination, and because the images are typically in color 
and at high-resolution, the composite images place 
significant storage and bandwidth requirements on the 
medical imaging system. For example, a composite image for 
a single tissue slide can often exceed a gigabyte in size. 

[0005] Image storage and archival devices provide a 
central library for storing the medical images captured by 
the image acquisition device. Image storage devices 
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include one or more databases and image servers for fast 
access to recently acquired images. Archival devices, such 
as optical disc jukeboxes and tape backup systems, provide 
long-term storage. When a pathologist wishes to view an 
archived image, the image is automatically "migrated" from 
the corresponding archival device to one of the image 
storage devices. 

[0006] Diagnostic quality view stations display the 
images captured by the image acquisition system. In order 
to assist the pathologist in interpreting a medical image, 
a view station is able to perform a variety of image 
analysis operations on the medical image for the purposes 
of diagnosis. Unlike other types of image processing, 
image analysis operations are not used to manipulate or 
produce another image from a subject image, but rather to 
analyze the information in the subject image to produce a 
"non-image" result, such as a fixed number (or "score"), 
often falling within a predetermined range. For example, 
the pathologist at the view stations may invoke algorithms 
to perform densitometry on selected regions of the medical 
image in order to identify concentration of a particular 
analyte within the tissue sample. Other image analysis 
operations are useful for finding objects within the image 
such as the nuclei of the cells, computing an integrated 
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optical density for the nuclei of the cells and reporting 
the number of molecules per cell. 

SUMMARY 

[0007] In general, the invention facilitates the remote 
interpretation of medical images. In order to facilitate 
the timely diagnosis of a tissue sample, it is desirable 
that a medical professional, such as a pathologist, be able 
to remotely view and interpret a medical image. The 
immense size of a medical image for a single tissue sample 
typically makes remote viewing unworkable due to bandwidth 
constraints. Compression algorithms can produce an image 
suitable for transmission, but the data lost during 
compression can lead to inaccurate results from the image 
analysis operations. 

[0008] According to one aspect, the invention is 
directed to a system in which a remote view station is 
communicatively coupled to an image server and receives a 
compressed version of a source medical image. The remote 
view station uncompresses and displays the received medical 
image. The remote view station selects a region of the 
displayed medical image as a function of input received 
from a medical professional, such as a pathologist. Based 
on the input, the remote view station transmits region 
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information, such as a series of pixel coordinates, back to 
the image server. The image server applies image analysis 
operations to a region of the source medical image that 
corresponds to the selected region of the compressed 
medical image. In this manner, the data loss that occurs 
during image compression does not effect the image analysis 
operations. As such, the image analysis operations produce 
more accurate results than if the operations were applied 
by the remote view station on the compressed image. 
[0009] In another aspect, the invention is directed to a 
method for remotely interpreting medical images. According 
to the method, a compressed medical image is generated from 
a source medical image and transmitted from an image server 
to a remote view station for display. In one 
implementation, the compressed medical image is transmitted 
over a global packet-switched network such as the Internet. 
A region of the medical image displayed by the remote view 
station is selected in response to input from a medical 
professional. Region information, defining the selected 
region of the displayed medial image, is transmitted from 
the remote view station back to the image server. Based on 
the region information, image analysis operations are 
applied to a corresponding region of the source medical 
image. A resulting score is communicated to the remote 
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view station for display. A diagnosis is received from the 
remote view station and associated with the source medical 
image in a database maintained by the image server. 
[0010] Various embodiments of the invention are set 
forth in the accompanying drawings and the description 
below. Other features and advantages of the invention will 
become apparent from the description, the drawings, and the 
claims . 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0011] FIG. 1 is a block diagram providing a high-level 

illustration of the various components of the invention. 
[0012] FIG. 2 is a flowchart illustrating one embodiment 

of a process for remotely interpreting medical images. 
[0013] FIG. 3 is a block diagram illustrates one 

embodiment of a computer suitable for implementing the 

various embodiments of the invention. 

DETAILED DESCRIPTION 
[0014] Figure 1 is a block diagram illustrating a 

system 10 that facilitates remotely viewing and 
interpreting medical images. System 10 includes remote 
view station 26 this is communicatively coupled to medical 
imaging system (MIS) 12 by network 20, which represents any 
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packet -switched network such as a local area network or the 
Internet. MIS 12 includes image acquisition devices 14 
that represent any medical imaging device that generates 
digital medical images, such as an electronic camera used 
in conjunction with an automated microscope. Other image 
acquisition devices include computed tomography (CT) , 
nuclear medicine, magnetic resonance imaging (MRI) , 
ultrasound and X-ray devices. Image server 24 stores the 
images that are generated by image acquisition device 14 
and, upon request, communicates the images to view stations 
16 for display. Using view stations 16, a medical 
professional, such as a pathologist, can perform a variety 
of image analysis techniques on selected regions to assist 
in rendering a diagnosis. 

[0015] As described in detail below, image server 24 of 
MIS 12 communicates compressed medical images to remote 
view station 26 for interpretation by a medical 
professional. Using a network software application, such 
as a web browser, the medical professional interacts with 
remote view station 2 6 to select various regions of 
interest within the image. Based on the selection, image 
server 24 applies image analysis functions directly to the 
source medical image stored on image server 24, thereby 
generating a more accurate score than if applied by remote 
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view station 26 to the medical image after compression. 
The resultant score produced by the image analysis 
operations is communicated to remote view station 2 6 to 
assist the medical professional in interpreting the medical 
image and rendering a diagnosis. 

[0016] Figure 2 is a flow chart illustrating one 
implementation of a process 28 that facilitates the 
interpretation of medical images via remote view station 
26. Using a network software application the medical 
professional interacts with remote view station 26, 
accesses MIS 12 and receives a list of cases that are 
marked for review, i.e., cases in which images have been 
acquired by image acquisition devices 14 but have not been 
reviewed by a medical professi onal (3 0) . Upon reviewing 
the list displayed by remote view station 26, the medical 
professional selects one of the cases for review (32) . 

[0017] Based on the selection, image server 24 
compresses medical images associated with the case and 
communicates the compressed images to remote view station 
26 via network 20 (34) . Remote view station 26 
decompresses the images and displays the uncompressed 
images for review by the medical professional (36) . The 
image server 24 may use a lossy compression technique, 
e.g., JPEG. Such techniques attempt to eliminate redundant 
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or unnecessary information. Consequently, in lossy 
compression, some information is lost, and the displayed 
image is not a pixel -by-pixel duplicate of the original 
source image stored on image server 24 . Several 
algorithms, however, are known that can achieve a 
compression ratio, such that the compressed image uses 
relatively low bandwidth, without significantly changing 
the visual representation of the image. Therefore, 
compressing the image can be effectively lossless with 
respect to human vision. For example, it has been found 
that both JPEG compression and fractal image compression, 
when set for to moderate compression, result in images 
suitable for transmission without resulting in data loss 
perceptible with human vision. 

[0018] Using a pointing device, such as a light pen, 
mouse or track ball, the medical professional selects one 
or more regions of interest. The medical professional can 
tag a region for image analysis or can request that image 
server 24 transmit image data for the selected region using 
a lower compression setting. For example, the medical 
professional can direct image server 24 to transmit an 
image using low compression or even to transmit an 
uncompressed pixel -by-pixel duplicate of the selected 
region. Remote view station 26 encodes the shape and size 



9 



Attorney Docket No.: 10225/061001 

of the selected region and transmits the region information 
to MIS 12 by network 20 (38) . The region information 
defines the boundaries of the selected regions and, in one 
implementation, is a set of pixel coordinates defining the 
outlines of the selected regions. As such, the region 
information typically comprises a small amount information 
and can be quickly transmitted to image server 24. 
[0019] If the medical professional requests that image 
server 24 transmit image data for a region of interest 
using a lower compression setting, or no compression, then 
image server 24 extracts the corresponding pixel data from 
the source image and communicates the pixel data to remote 
view station 26 (40) . In this fashion, the medical 
professional can view regions of interest at higher 
resolution, or even a pixel -per-pixel duplicate, without 
requiring that image server 24 transmit the entire source 
image across network 20. Upon viewing the region of 
interest, the medical professional can tag the region for 
image analysis or can select sub-regions of interest. In 
an alternative embodiment, the image server 24 may 
calculate "difference data" for the selected region, e.g., 
data lost during the lossy compression operation for the 
selected region. The image server may then transmit the 
difference data to the remote view station 26. The remote 
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view station 2 6 may then use the difference data and 
compressed (and/or decompressed) image file to reconstruct 
an image of the selected region of higher resolution for 
display at the remote view station 26. By sending only the 
difference data, the amount of data transmitted over the 
network may be significantly reduced, thereby reducing 
network traffic and transmission times. 
[0020] If the medical professional tags a selected 
region for image analysis, image server 24 executes the 
requested image analysis operation on the corresponding 
source medical image (42) . More specifically, image server 
24 analyzes the region information received from remote 
view station 26 and applies the image analysis operation to 
a subset of the pixel data of the source image. The subset 
pixel data is selected based on the boundaries defined by 
the region information received from remote view station 
26. In this manner, the image analysis operation produces 
a more accurate score than if the operation were applied by 
remote view station 2 6 to the image that has been 
compressed for transmission and then uncompressed for 
display at the remote view station. As such, the data loss 
that occurs during compression does not effect the image 
analysis . 
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[0021] Image server 24 communicates the scores for each 
region to remote view station 26 for display to the medical 
professional (44) . Based on the visual display of the 
medical image as well as the scores associated with regions 
of interest, the medical professional interprets the 
medical image and renders a diagnosis. For example, the 
medical professional may determine that a particular tissue 
sample is cancerous. Remote view station 26 communicates 
the diagnosis to MIS 12 for association with the 
appropriate case within a database maintained by image 
server 24 (46) . 

[0022] The invention can be implemented in digital 
electronic circuitry, or in computer hardware, firmware, 
software, or in combinations thereof. Furthermore, the 
invention can be implemented in one or more computer 
programs that are executable within an operating 
environment of a programmable system embodied and tangibly 
stored in a machine- readable storage device. 

[0023] Figure 3 illustrates an example of a computer 100 
suitable for use as view station 26 in order to implement 
or perform various embodiments of the invention. As shown 
in Figure 3, the computer 100 includes a processor 112 that 
in one embodiment belongs to the PENTIUM® family of 
microprocessors manufactured by the Intel Corporation of 
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Santa Clara, California. However, computer 100 can be 
implemented on computers based upon other microprocessors, 
such as the MIPS® family of microprocessors from the 
Silicon Graphics Corporation, the POWERPC® family of 
microprocessors from both the Motorola Corporation and the 
IBM Corporation, the PRECISION ARCHITECTURE® family of 
microprocessors from the Hewlett-Packard Company, the 
SPARC® family of microprocessors from the Sun Microsystems 
Corporation, or the ALPHA® family of microprocessors from 
the Compaq Computer Corporation. 

[0024] Computer 100 includes system memory 113, 
including read only memory (ROM) 114 and random access 
memory (RAM) 115, which is connected to the processor 112 
by a system data/address bus 116. ROM 114 represents any 
device that is primarily read-only including electrically 
erasable programmable read-only memory (EEPROM) , flash 
memory, etc. RAM 115 represents any random access memory 
such as Synchronous Dynamic Random Access Memory. 

[0025] Within the computer 100, input/output bus 118 is 
connected to the data/address bus 116 via bus controller 
119. In one embodiment, input/output bus 118 is implemented 
as a standard Peripheral Component Interconnect (PCI) bus. 
The bus controller 119 examines all signals from the 
processor 112 to route the signals to the appropriate bus. 
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Signals between the processor 112 and the system memory 113 
are merely passed through the bus controller 119. However, 
signals from the processor 112 intended for devices other 
than system memory 113 are routed onto the input /output bus 
118. 

[0026] Various devices are connected to the input/output 
bus 118 including hard disk drive 12 0, floppy drive 121 
that is used to read floppy disk 151, and optical drive 
122, such as a CD-ROM drive that is used to read an optical 
disk 152. The video display 124 or other kind of display 
device is connected to the input/output bus 118 via a video 
adapter 125 and preferably is a high-resolution display 
suitable for viewing medical images. Computer 100 also 
includes a modem 12 9 and network interface 53 for 
communicating over network 2 0 via either a wired or 
wireless connection. 

[0027] A medical professional enter commands and 
information into the computer 100 by using a keyboard 140 
and/or pointing device, such as a mouse 142, which are 
connected to bus 118 via input/output ports 128. Other 
types of pointing devices (not shown in Figure 1) include 
track pads, track balls, joysticks, data gloves, head 
trackers, and other devices suitable for positioning a 
cursor on the video display 124. 



14 



Attorney Docket No.: 10225/061001 

[0028] Software applications 136 and data are typically 
stored via one of the memory storage devices, which may 
include the hard disk 120, floppy disk 151, CD-ROM 152 and 
are copied to RAM 115 for execution. Operating system 135 
executes software applications 13 6 and carries out 
instructions issued by the user. The Basic Input/Output 
System (BIOS) 117 for the computer 100 is stored in ROM 114 
and is loaded into RAM 115 upon booting. BIOS 117 is a set 
of basic executable routines that help transfer information 
between the computing resources within the computer 100. 

[0029] A number of embodiments have been described. 
Nevertheless, it will be understood that various 
modifications may be made without departing from the spirit 
and scope of the invention. For example, blocks in the 
flowchart may be skipped or performed out of order and 
still produce desirable results. Accordingly, other 
embodiments are within the scope of the following claims. 
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